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Abstract 

Three measures of the information content of a probability distri- 
bution are briefly reviewed. They are applied to fractional occupation 
probabilities in light nuclei, taking into account short-range correla- 
tions. The effect of short-range correlations is to increase the infor- 
mation entropy (or disorder) of nuclei, comparing with the indepen- 
dent particle model. It is also indicated that the information entropy 
can serve as a sensitive index of order and short-range correlations 
in nuclei. It is concluded that increasing Z, the information entropy 
increases i.e. the disorder of the nucleus increases for all measures of 
information considered in the present work. 

1 Introduction 



The Boltzmann-Gibbs-Shannon information entropy^ Ej of a discrete 
probability distribution (pi,p2, ■ ■ ■ ,Pk) is denned as the quantity 

k 

S = -^Pilnpi (1) 

i=l 

with the constraint Yl!i=iPi = 1- S i s measured in bits if the base of the 
logarithm is 2 and in nats (natural units of information) if the logarithm 
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is natural. This quantity appears in different areas: information theory, 
ergodic theory and statistical mechanics. It is closely related to the entropy 
and disorder in thermodynamics. The maximum value of S is S max = In k 
obtained if p\ — pi — ■ ■ ■ — Pk- The minimum value of S is found when one of 
the p^s equals 1 and all the others are equal to 0. Then S m i n = 0. Information 
entropy was first introduced by Shannon as a way to measure the information 
content or uncertainty in a distribution. It has been applied in many cases 
e.g. the quantum mechanical description of physical systems. [H] — [2] 
For continuous probability distributions, S is defined by the integrals 

S r = — f p(f) \np(f)df 

S k = - JT n(jfe) In n{k)dk (2) 
Ss — S r + Sfc 

where p(r), n(k) are the density distributions of the system in position-space 
and momentum-space respectively. S r , Sk depend on the unit of r and k, but 
the important quantity is the sum S r + Sk which is invariant to a uniform 
scaling of coordinates. 

The discrete case considered in this work corresponds to a discrete prob- 
ability distribution p^ which in the literature (atomic case) is Pi = ^, where 
rii is the occupation number of the i-th natural orbital of the electron, divided 
by Z for normalization to 1. If pi is inserted into ((TJ gives 

^ = -E| ln | ( 3 ) 

which is called Jaynes entropy (atomic case). We extend the above definition 
to nuclear fractional occupation probabilities by putting into 

Pi = p q (Table 1), where q = Is, lp, Id, . . . (4) 

We also call this Jaynes entropy and use the same symbol Sj. 

In quantum information theory and its applications in chemistry, [22] there 
are two definitions of S referred to as Sj aynes = Sj (discrete case) and 
S shannon = S s (continuous case). S jaynes = Sj and S shannon = S s were 
calculated and compared in chemical systems. j2S] A relationship between 
them was found as well as a connection with correlation energy E corr with 
considerable success. [TU] 

The aim of the present work is to extend the above calculations to nuclear 
physics evaluating Sj in nuclei. Ss was obtained previously, [TU] where a uni- 
versal property Ss = a + b In jV was proposed (N is the number of nucleons 
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in nuclei, valence electrons in atomic clusters and electrons in atoms). It is 
remarkable that this relation holds in various systems in spite of the fact that 
the interaction is different. We also employ two alternative information mea- 
sures (discrete) for the sake of comparison i.e. Onicescu's Se and Stotland's 
S f described below (Section 2). 

It has been found that S$ is important in chemical systems as a measure of 
basis set quality^ and is related to various properties e.g. the kinetic energy, 
ionization potentials and can serve as a similarity index. A recent example of 
application of Sj in organic chemistry is,j2H| where the information entropy 
of Coulomb electron pairs (with antiparallel spins) and Fermi ones (with 
parallel spins) in a molecule was estimated. It was found that Sj of Fermi 
pairs is less than that of Coulomb ones indicating that Fermi pairs are more 
ordered (or structured) than Coulomb ones. In nuclear physics a relation of 
Ss with kinetic energy was obtained, [TT] while a universal trendJTJ] of Ss 
for the single particle state of a fermion in a mean field was proposed for 
various systems i.e. a nucleon in a nucleus, a A particle in a hypernucleus 
and an electron in an atomic cluster. Also a relation Ss — k In (fiE + v) for 
the entropy of single particle states was proposed as function of the single 
particle energy E. The concept of information entropy also proved to be 
fruitful in a different context, i.e. the formalism of Ghosh, Berkowitz and 
Parr. [9 It turned out that employing their definition of information entropy, 
Ss can serve as a criterion of the quality of a nuclear model by observing 
that Ss increases with the quality of a nuclear model. 

The outline of the paper is the following: In Section 2 two alternative 
measures of information are described (according to Onicescu and Stotland). 
In Section 3 a simple model for the estimation of fractional occupation prob- 
abilities is briefly reviewed. Section 4 contains a calculation of information 
entropies employing three measures of information, while our conclusions are 
briefly stated in Section 5. 

2 Alternative measures of information 

The information energy [To]- [T7j of a single statistical variable x with the 
normalized density p(x) is defined by 




(5) 
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For a Gaussian distribution of mean value fi, standard deviation a and nor- 
malized density 

/ \ 1 (*-M) 2 . , 

PW = -/^ e ( 6 ) 

V/7T 0" 



relation (0) gives 

1 / (x-m) 



27TO" 

Thus 



#(p) = 7^ / e-^dx (7) 



<x> 



Therefore, the greater the information energy E, the narrower is the Gaussian 
distribution. 

Relation (j^J) was proposed by Onicescu|15^ITT)] who tried to define a finer 
measure of information. For a discrete probability distribution one has: 



E = J2p* ( 9 ) 



»=i 

The maximum value of E is obtained if one of the pi's equals 1 and all the 
others are equal to zero i.e. E max = 1 (total order), while E is minimum 
when pi = p 2 = . . . = Pk = \ , hence E min = | (total disorder). Because 
E reaches minimum for equal probabilities (total disorder), by analogy with 
thermodynamics, it has been called information energy, although it does 
not have the dimension of energy. 18 It has been connected with Planck's 
constant appearing in Heisenberg's uncertainty relation. |19j 

So far only the mathematical aspects of this concept have been developed, 
while its physical aspects have been neglected. The greater the information 
energy, the more concentrated is the probability distribution, while the in- 
formation content decreases. Thus the relation between E and information 
content Se is reciprocal: 

Se = \ (10) 

where Se is the information corresponding to E. 

Very recently Stotland et alj201 defined a new measure of information 
entropy by the relation: 

F=-DII -^—]pAnp r (11) 
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e.g. for k = 2 we get: 

F = —(pi In ip x ) - p\ In (p 2 )) (12) 

Pi ~P2 

The expression of information content analogous to Shannon entropy is: 

S F = S (k) + F (13) 

where So(k) is the minimum uncertainty entropy of a quantum system and 
the second term is called the excess statistical entropy. S (k) is given by the 
relation: 

k 
i=2 

Sf in relation (3) of[19 j is denoted by S[p\. 



3 Fractional occupation probabilities 

In|2I]-[2ni a simple method was proposed for the introduction of short 
range correlations (SRC) in the ground state nuclear wave function for nu- 
clei in the region 4 < A < 40. The correlations were of the Jastrow type 
and the correlation parameters were determined by fitting the charge form 
factor experimental data. The above method gives the correlated proton 
density distribution p cor (r). In[21j p CO r(r) was used as input in a method 
for the determination of fractional occupation probabilities, where the nat- 
ural orbital representation (NOR) is employed, by imposing the condition 
Pcor( r ) — Pn.o( r ) where p n . (r) is the density distribution constructed by nat- 
ural orbitals. This provides a systematic study of the effect of SRC on the 
occupation numbers of the shell model orbits and the depletion of the nuclear 
Fermi sea in light nuclei. 

The "natural orbitals" <f> q are defined [21] as the orthogonal basis which 
diagonalizes the one-body density matrix 

p(f,f') = J2^ q (r)<P g (f') (15) 

where a q is the occupation number of the state q (= nlj). Thus the density 
distribution takes the simple form: 

nl 
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where n q = is the occupation probability of the q (= nlj) state. 
In|2T] we used occupation probabilities n n i related to n n ij as follows: 

l + l I 

n nl = 2/ _|_ i n nl,l+l/2 + 2/ _|_ i n nl,l-l/2 I 1 ') 

Values of n n i for various states and nuclei can be found in Table IV of 21 
(case A in the present work) and Table I of [22] (case B). In case B a sort of 
state dependence of the single particle wave functions in the "natural orbital" 
representation was taken into account. 



4 Calculation of information entropies and 
discussion 

In the present work we employ the probabilities p q = n " 1 2 ^ +1 ) which 
sum up to 1 {^2 q p q = 1). Probabilities p q are shown in Table 1. Using 
these values we calculate the information entropies of light nuclei according 
to Jaynes (Sj), Onicescu (Se) and Stotland (Sp) as functions of the atomic 
number Z. 

It is seen that the above information entropies show a similar behaviour 
i.e. they are increasing functions of Z for all cases A, B, C considered in 
the present work (case C corresponds to IPM-Independent Particle Model). 
IPM is a starting point for the nuclear many body problem. In Table 1 we 
show p q for 16 and 40 Ca for IPM. However, due to the interaction between 
nucleons including short-range correlations (SRC), nucleons are excited to 
higher levels and the Fermi surface is depleted giving fractional occupation 
probabilities of energy levels, which deviate from the standard values of IPM. 

It is concluded that increasing Z the information entropy increases i.e. 
the disorder of a nucleus increases for three measures of information. 

In the present work we look at the information content (Sj) of nuclei 
by employing the occupation probabilities of protons distributed to energy 
levels. The corresponding probability distribution (pi,P2, ■ ■ ■ ,Pk) is discrete. 
In previous work^U] we calculated the information entropy for a continuous 
density distribution p(r) (position space) and n(k) (momentum space) of 
nucleons in nuclei (and other systems as well i.e. atoms and atomic clusters). 
We proposed the universal relation Ss = a + 6 In N described above. 

The two ways of looking at information entropy give at least the same 
qualitative behaviour, i.e. the information entropy increases (disorder in- 
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creases) as Z increases. However, the depletion of the Fermi sea due to 
short-range correlations is in our model about 32% i.e. about constant, at 
least for the region of Z considered (4 < Z < 40). This indicates that the 
information entropy is a sensitive index of disorder of a nucleus. 

We may also calculate Sj, Se, Sf for the IPM occupation probabilities 
of the shell model orbits (case C) and compare with the values of entropy 
corresponding to fractional occupation probabilities due to short-range cor- 
relations (case A and B). Thus the effect of SRC can be assessed by looking 
at the differences of the corresponding values of entropy. It is seen that 
SRC increase Sj, Se, Sf comparing with the corresponding values calculated 
according to IPM. A similar trend was found in[S] for Ss calculated with 
correlated and uncorrected continuous density distributions p(r) and n{k). 
It is noted that for 40 Ca (Case C) we do not present any value for Sf (Table 
1) because in this case the probabilities p q for n\ s , n<i s are equal and thus Sf 
diverges. It is also seen that the information entropies in case B are smaller 
than those in case A, indicating that the inclusion of state dependence de- 
creases the values of entropy i.e. increases the order of nuclei. 

A final comment seems appropriate. Information entropy for a discrete 
probability distribution (denoted as Sj ayn es = Sj in [23]) is minimal for IPM 
and maximal for an unbound system and also for an extreme wave function 
i.e. the natural orbitals are equally occupied with p q < 1. In a similar sense, 
information entropy for a continuous probability distribution (denoted as 
Sshannon — Ss in|2n|) is maximal for a uniform distribution e.g. that of an 
unbound system and is minimal e.g. a delta-like distribution. In fact, the 
two types of S were compared for chemical systems. In our nuclear case 
the two measures of information are shown as functions of Z in Fig. 1, where 
the values of information in the continuous case are obtained using a linear 
relation Ss = a + blnZ derived in^U] and in the discrete one from Sj of 
Table 1. Fig. 1 is analogous to the atomic case seen in Fig. 5.[23] 

It is seen that Ss, Sj increase as Z increases. This is expected for distri- 
butions normalized to 1. However, the case of Ss = S r + Sk which increases 
with Z is not completely evident, because as Z increases, S r increases, Sk de- 
creases and Ss = S r + Sk increases due to a delicate balance between S r and 
Sk (as seen in our previous work). This is the case with the entropic quantity 
Ss calculated with density distributions normalized to 1, while entropic-like 
quantities S calculated with density distributions normalized to the num- 
ber of particles are not monotonic functions of Z.^ However, one considers 
entropic quantities more desirable than entropic-like ones, because entropic 
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quantities are in the spirit of Shannon's definition using the relation ^2 Pi — 1 
(normalized to one). 

There is no obvious relation between Ss and Sj due to the non-linear 
nature of the logarithm. However, an attempt to compare various entropies 
was made for atoms in, '25^ where the following properties were reported and 
are summarized below. 

The Jaynes entropy per electron ^ is the difference between the ensemble 

average of the Shannon entropy per electron f — J and the ensemble average 
of the Shannon entropy of one electron S u (see[2E| relations (2.5) and (2.9)) 
which may be interpreted as a measure of the difference in the average shape 
of the square of a natural orbital per electron, and the shape of the square of 
a natural orbital of one electron. This property is expressed in the following 
relationship 

§ = (I*) -^ = ^V-^~e (18) 

Here S u corresponds to a probability distribution normalized to 1, where the 
ensemble average of the quantity F is defined as: 

p = "Hi p. 

j 

Ej is the single particle energy in state j and \i is the chemical potential. 

Relation (|T5j) is interesting, since it equates the differences from a density 
perspective (the orbital entropies) to energetic differences. 

We conclude by giving an interesting relation between / (the orbital 
mean excitation of an atom) and (^f): 

, r 1 (S v \ , ln47r . . 

ln/ = --^J + ln 7+ — (19) 

Here S v corresponds to distributions normalized to N (7 is a correction term 
for the shift in the plasma frequency due to the chemical environment). The 
above properties represent a considerable progress in chemistry for under- 
standing the concept of information entropy. Although we have found inter- 
esting relationships as described in^2] we hope that more progress will be 
made in similar matters in nuclear physics. 

Finally, it is noted that a study of Ss and Sj for correlated bosons in a 
trap is carried out in [27j with results analogous to Fig. 1. 
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5 Conclusions 



A simple model of fractional occupation probabilities in light nuclei is 
employed to calculate the information entropy S as function of the atomic 
number Z. For the sake of comparison, three different definitions of informa- 
tion content of a quantum system are used i.e. according to Jaynes, Onicescu 
and Stotland. It is concluded that S is an increasing function of Z in all cases. 
It is seen that short-range correlations increase S (or disorder) of nuclei. Also 
the inclusion of state dependent correlations decrease S (increase order). Fi- 
nally, the information entropy is proposed as a sensitive index of order and 
short-range correlations in nuclei. 

Acknowledgement: The authors thank Dr. G. A. Lalazissis for useful com- 
ments. 
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Nuclei 


Ills 


nip 


nid 


n 2s 


nif 


n 2p 


S 


Se 


Sf 


4 He(A) 


0.485 


0.515 










0.693 


1.998 


0.693 


12 C(A) 


0.223 


0.528 


0.249 








1.018 


2.561 


1.077 


12 C(B) 


0.265 


0.584 


0.151 








0.956 


2.304 


1.061 


16 0(A) 


0.172 


0.509 


0.299 


0.020 






1.086 


2.642 


1.333 


16 0(B) 


0.216 


0.596 


0.174 


0.015 






1.007 


2.313 


1.313 


16 0(C) 


0.250 


0.750 










0.562 


1.600 


0.650 


24 Mg(A) 


0.120 


0.350 


0.383 


0.055 


0.082 


0.010 


1.400 


3.408 


1.575 


28 Si(A) 


0.100 


0.296 


0.364 


0.060 


0.160 


0.017 


1.490 


3.852 


1.753 


28 Si(B) 


0.141 


0.420 


0.186 


0.043 


0.210 




1.416 


3.612 


1.578 


32 S(A) 


0.088 


0.259 


0.350 


0.062 


0.219 


0.022 


1.520 


4.006 


1.756 


32 S(B) 


0.107 


0.305 


0.351 


0.065 


0.158 


0.015 


1.501 


3.890 


1.752 


40 Ca(A) 


0.068 


0.201 


0.325 


0.064 


0.301 


0.042 


1.541 


4.047 


1.756 


40 Ca(B) 


0.093 


0.224 


0.359 


0.060 


0.237 


0.027 


1.531 


4.029 


1.756 


40 Ca(C) 


0.100 


0.300 


0.500 


0.100 






1.168 


2.778 





Table 1: Probabilities p q and values of information entropy (Shannon-S , 
Onicescu-SE and Stotland-Sp) for various nuclei. For cases A, B and C see 
text 
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ln(Z) 



Figure 1: Discrete Sj (present work) and Continuous S$ 11 Shannon in- 
formation entropies as functions of InZ 
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